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The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 
• Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)D Responsive to communication(s) filed on . 

2a)D This action is FINAL. 2b)K This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) M Claim(s) 1-26 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-26 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) Q Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) ^ The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
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1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

13) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application) 
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a) □ The translation of the foreign language provisional application has been received. 
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reference was included in the first sentence of the specification or in an Application Data Sheet. 37 CFR 1 .78. 
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PART III. DETAILED ACTION 

1. Claims 1-26 are presented for examination. 

Specification 

2. The disclosure, pages 1 and 13, are objected to because it contains an embedded 
hyperlink and/or other form of browser-executable code. The use of URL in the disclosure of 
United State Patent is prohibited. Due to the dynamic nature of the WWW, URL is not a 
consistent source for relevant information. Applicant is required to delete the embedded 
hyperlink and/or other form of browser-executable code. See MPEMP § 608.01 . 



Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patent ability shall not be negative by the 
manner in which the invention was made. 

4. Claims 1-26 are rejected under 35 U.S.C. 103(a) as being unpatentable over Baumgartner 
et al. (USPN: 5,642,171) hereinafter Baumgartner in view of Boezeman et al. (USPN: 6,188,396) 
hereinafter Boezeman. 

As per claims 1 (method) and 10 (system), Baumgartner discloses a method of adjusting 
tempo of an audio recording to match audio events to video in an audio-visual recording as the 
technique of synchronization by adjusting audio tempo (see col. 12, line 41) to be a common 
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starting point for the audio and video data (see col. 6, lines 34-35) in an audio-visual display (see 
col. 1, line 47), the method comprising: 

Receiving a reference indicating a location in a recording signal, the reference being 
indicative of a desired audio change location in the recording signal is taught by Baumgartner as 
the technique of to be a common starting point for the audio and video data (see col. 6, lines 34- 
35 and see Fig. 6) in an audio-visual display (see col. 1, line 47) wherein call preferably uses 
MCI interface commands. In step 5 12 the method calls the respective audio driver to determine 
the current audio position (see col. 13, lines 27-29). In step 518, the method determines if the 
audio is too far ahead of the video and if the audio is still playing. In the preferred embodiment 
the method determine if the audio is more than 5 frames ahead of the video in step 518. If the 
audio is determined to be too far ahead and is also playing in the step 518, then the method stops 
the audio in step 520 and then advances to step 522 (see col. 14, lines 1-7) wherein step 522 Is 
audio paused and video caught up? ( see Fig. 5). 

Baumgartner, however, does not disclose the limitation of providing a tempo for an audio 
to be at least partially included in the recording signal, the tempo being provided to fit the audio 
recording to a section of the recorded signal marked by the reference. 

Boezeman discloses the limitation of providing a tempo for an audio to be at least 
partially included in the recording signal, the tempo being provided to fit the audio recording to a 
section of the recorded signal marked by the reference as the technique of a Sequence Editor 
which during the course of the animation, a pieces of audio is also played. At the simulation 
ending of the animation and audio, a video plays (see col. 6, lines 58-62 and see Fig. 3-17). 
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It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of providing a tempo for an audio to be at 
least partially included in the recording signal, the tempo being provided to fit the audio 
recording to a section of the recorded signal marked by the reference into that of Baumgartner 
invention. By doing so, the system would be enhanced by providing an editor to an end user 
wherein the user can perform editing and synchronizing audio and video as well as animation 
tool to system user. 

As per claim 15, due to mostly similarity of this claim to that of claim 1, except for a 
Central Processing Unit CPU and a storage device coupled to the CPU. The limitation of a 
Central Processing Unit CPU and a storage device coupled to the CPU is taught by Baumgartner 
as the CPU 102 and CD-ROM 140 coupled to CPU (see Fig. 1). This claim is therefore rejected 
for the reason as set forth above. 

As per claim 21, Baumgartner discloses the limitation of a reference marker which is 
configured to be selectively located by a user, the reference marker being used in the tempo 
synchronization of at least a portion of the first audio recording and video recording as the 
technique of synchronization by adjusting audio tempo (see col. 12, line 41) to be a common 
starting point for the audio and video data (see col. 6, lines 34-35) in an audio-visual display (see 
col. 1, line 47), wherein a common starting point for the audio and video data (see col. 6, lines 
34-35 and see Fig. 6) in an audio-visual display (see col. 1, line 47) wherein call preferably uses 
MCI interface commands. In step 512 the method calls the respective audio driver to determine 
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the current audio position (see col. 13, lines 27-29). In step 518, the method determines if the , 
audio is too far ahead of the video and if the audio is still playing. In the preferred embodiment 
the method determine if the audio is more than 5 frames ahead of the video in step 518. If the 
audio is determined to be too far ahead and is also playing in the step 518, then the method stops 
the audio in step 520 and then advances to step 522 (see col. 14, lines 1-7) wherein step 522 Is 
audio paused and video caught up? ( see Fig. 5). 

Baumgartner, however, does not disclose the limitations of a first graphical display area 
on which graphical representations of a first audio recording can be displayed and a second 
graphical display area on which graphical representations of a second video recording can be 
displayed. 

Boezeman discloses the limitations of a first graphical display area on which graphical 
representations of a first audio recording can be displayed and a second graphical display area on 
which graphical representations of a second video recording can be displayed as the technique of 
graphical channel 104 representations for Audio Play and graphical channel 106 representations 
for Video Play in Sequence Editor (see Figs. 2 and 10). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of a first graphical display area on which 
graphical representations of a first audio recording can be displayed and a second graphical 
display area on which graphical representations of a second video recording can be displayed 
into that of Baumgartner invention. By doing so, the system would be enhanced by providing an 
editor to an end user wherein the user can perform editing and synchronizing audio and video as 
well as animation to system user. 
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As per claim 2 (method) and 16 (system), Baumgartner discloses the invention 
substantially as claimed above. Baumgartner, however, does not disclose the limitation of 
wherein the reference is indicative of a time location in the recorded signal to coincide a musical 
event with a particular frame of video. 

Boezeman discloses the limitation of wherein the reference is indicative of a time 
location in the recorded signal to coincide a musical event with a particular frame of video as the 
technique of below the time-line 84, are a plurality of visibility channels 102, 104, 106, 108 and 
110 (see col, 6, lines 45-46) and the play tool 88 is dragged and dropped onto the show block 
107, as indicated by a play icon 152 and a play area 153. As with the audio portion of audio 
player part 140 (see col. 7, lines 45-48 and see Fig. 8). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of wherein the reference is indicative of a 
time location in the recorded signal to coincide a musical event with a particular frame of video 
into that of Baumgartner invention. By doing so, the system would be enhanced by providing 
graphical tools to an end user wherein the end user can perform drag and drop technique for 
synchronizing audio event to video thumbnail. 

As per claim 1 1, due to the similarity of this claim to that of claim 2, this claim is 
therefore rejected for the same reason applied to claim 2. 
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As per claim 3, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner disclose the limitation of wherein the reference is indicative of a location in the 
audio recording to be synchronizing as the technique of synchronization by adjusting audio 
tempo (see col. 12, line 41) to be a common starting point for the audio and video data (see col. 
6, lines 34-35) in an audio-visual display (see col. 1, line 47). Baumgartner, however, does not 
disclose time reference in the recorded signal. 

Boezeman discloses time reference in the recorded signal as the technique of time line 84 
(see col. 6, line 45). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of time reference in the recorded signal into 
that of Baumgartner audio and video synchronization invention. By doing so, the system would 
be enhanced by providing more detail information in order to control synchronizing task. 

As per claim 4, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of providing a user interface via 
computing device for providing graphical representations of the recorded signal and audio 
recording to be at least partially included in the recorded signal; 

Boezeman discloses the limitation of providing a user interface via computing device for 
providing graphical representations of the recorded signal and audio recording to be at least 
partially included in the recorded signal as the technique of Sequence Editor for providing 
graphical channel 104 representations for Audio Play and graphical channel 106 representations 
for Video Play Editor (see Figs. 2 and 10). 
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It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of providing a user interface via computing 
device for providing graphical representations of the recorded signal and audio recording to be at 
least partially included in the recorded signal into that of Baumgartner invention. By doing so, 
the system would be enhanced by providing an editor to an end user wherein the user can 
perform editing and synchronizing audio and video as well as animation to system user. 

As per claim 5, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of wherein the graphical representations 
include an audio waveform, wherein the user interface provides for the selective manipulation of 
characteristic of the audio waveform. 

Boezeman discloses the limitation of wherein the graphical representations include an 
audio waveform, wherein the user interface provides for the selective manipulation of 
characteristic of the audio waveform as the technique of Audio waveforms (see Figs. 6 and 10) 
wherein the play tool 88 is dragged and dropped onto the visibility block 105 as indicated by a 
play icon 142 and a play area 143. Since a piece of audio plays for a finite period of time, the 
audio player part 140 can be seen to have an approximate duration of about 30 seconds (see col. 
7, lines 32-36) and by selecting first the animation player area 13 1 and then the audio player area 
143 and then the co-occur tool 70, it is ensured that the animation player part and the audio 
player part will start and stop simultaneously. Since the audio was only 30 seconds in length, the 
audio will obviously have to be replayed the 100 second length of the animation (see col. 7, lines 
58-65). 
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It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of wherein the graphical representations 
include an audio waveform, wherein the user interface provides for the selective manipulation of 
characteristic of the audio waveform into that of Baumgartner invention. By doing so, the system 
would be enhanced by providing audio waveform graphical tool to an end user wherein the end 
user can manipulate audio waveform based on user's desired task. 

As per claim 6, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of selective manipulation provided by 
user interface includes providing for the increase in length of the audio waveform, thereby 
increasing the duration of the audio recording to be at least partially included in the recorded 
signal. 

Boezeman discloses the limitation of selective manipulation provided by user interface 
includes providing for the increase in length of the audio waveform, thereby increasing the 
duration of the audio recording to be at least partially included in the recorded signal as the 
technique of wherein the play tool 88 is dragged and dropped onto the visibility block 105 as 
indicated by a play icon 142 and a play area 143. Since a piece of audio plays for a finite period 
of time, the audio player part 140 can be seen to have an approximate duration of about 30 
seconds (see col. 7, lines 32-36 and see Fig. 6) and by selecting first the animation player area 
131 and then the audio player area 143 and then the co-occur tool 70, it is ensured that the 
animation player part and the audio player part will start and stop simultaneously. Since the 



Application/Control Number: 09/882,646 Page 10 

Art Unit: 2173 

audio was only 30 seconds in length, the audio will obviously have to be replayed the 100 second 
length of the animation (see col. 7, lines 58-65 and see Fig. 10). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of selective manipulation provided by user 
interface includes providing for the increase in length of the audio waveform, thereby increasing 
the duration of the audio recording to be at least partially included in the recorded signal into that 
of Baumgartner invention. By doing so, the system would be enhanced by providing audio 
waveform graphical tool to an end user wherein the end user can manipulate by increasing or 
lengthening audio waveform based on user's desired task. 

As per claims 7 (method) and 12 (system), Baumgartner discloses the invention 
substantially as claimed above. Baumgartner, however, does not disclose the limitation of audio 
recording to be at least partially included in the recorded signal comprising receiving an 
indication of a beginning and an end of the audio recording segment. 

Boezeman discloses the limitation of audio recording to be at least partially included in 
the recorded signal comprising receiving an indication of a beginning and an end of the audio 
recording segment as the technique of Sequence Editor for display Audio Play (see Fig. 6) and 
starting and ending time of the audio with respect to animation (see col. 8, lines 36-37). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of audio recording to be at least partially 
included in the recorded signal comprising receiving an indication of a beginning and an end of 
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the audio recording segment into that of Baumgartner invention. By doing so, the system would 
be enhanced by providing more detail of timing information to an end user. 

As per claims 8 (method) and 13 (system), Baumgartner discloses the invention 
substantially as claimed above. Baumgartner, however, does not disclose the limitation of 
displaying video thumbnails of video images in the recorded signal on a user interface, the user 
interface having time indications labeling the video thumbnails according to time appearance. 

Boezeman discloses the limitation of displaying video thumbnails of video images in the 
recorded signal on a user interface, the user interface having time indications labeling the video 
thumbnails according to time appearance as the technique of Video Play thumbnail (see Figs. 7- 
16) and under time-line 84 (see page 6, line 45) for time indication labels. 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of displaying video thumbnails of video 
images in the recorded signal on a user interface, the user interface having time indications 
labeling the video thumbnails according to time appearance into that of Baumgartner invention. 
By doing so, the system would be enhanced by providing more detail of timing information to an 
end user. 

As per claims 9 (method) and 14 (system), Baumgartner discloses the invention 
substantially as claimed above. Baumgartner, however, does not disclose the limitation of 
displaying audio representations of the audio recording to be at least partially included in the 
recorded signal, the audio representations being label with the time indication. 
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Boezeman discloses the limitation of displaying audio representations of the audio 
recording to be at least partially included in the recorded signal, the audio representations being 
label with the time indication as the technique of Audio Play thumbnail (see Figs. 5-16) and 
under time-line 84 (see page 6, line 45) for time indication labels. 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of displaying audio representations of the 
audio recording to be at least partially included in the recorded signal, the audio representations 
being label with the time indication into that of Baumgartner invention. By doing so, the system 
would be enhanced by providing more detail of timing information to an end user. 

As per claim 16, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of the presentation device is configured 
to provide a graphical user interface, which presented portion of the recorded signal and the 
audio recording segment. 

Boezeman discloses the limitation of presentation device is configured to provide a 
graphical user interface, which presented portion of the recorded signal and the audio recording 
segment as the technique of visual interface (see col. 10, line 4) for providing Sequence Editor 
for providing Audio Play and Video Play (see Figs. 5-16). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of presentation device is configured to 
provide a graphical user interface, which presented portion of the recorded signal and the audio 
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recording segment into that of Baumgartner invention. By doing so, the system would be 
enhanced by providing more detail of timing information to an end user. 

As per claim 17, Baumgartner discloses the limitation of an interface device configured 
to connect CPU with a network of computers as the technique of the audio and video data may 
be stored on media located in other computer systems that are connected to the computer system 
via a network (see col. 8, lines 30-33). This claim is therefore rejected for the reason as set forth 
above. 

As per claim 18, the limitation of wherein the storage device having stored files 
containing video image information is taught by Baumgartner as the technique of CD-ROM 140 
and a hard driver 142, as well as others. One or more of these mass storage devices store video 
and audio data, which is used during representation (see col. 8, lines 24-27). This claim is 
therefore rejected for the reason as set forth above. 

As per claim 19, the limitation of wherein the CPU is configured to assign the provided 
tempo to the audio recording segment is taught by Baumgartner as the technique of the 
synchronization method of the present invention makes calls directly to the API of the audio and 
video drivers to obtain the necessary information and control tempo of one of the respective data 
streams to maintain synchronization (see col. 10, lines 2-6). This claim is therefore rejected for 
the reason as set forth above. 
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As per claim 20, the limitation of wherein the CPU is further configured to save file to 
the storage device, the file including information related to the video, the audio recording 
segment and the provided tempo is taught by Baumgartner as the technique of CD-ROM 140 and 
a hard driver 142, as well as others. One or more of these mass storage devices store video and 
audio data, which is used during representation (see col. 8, lines 24-27). This claim is therefore 
rejected for the reason as set forth above. 

As per claim 22, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of wherein the reference marker is a 
location marker indicating a measure location in the first audio recording. 

Boezeman discloses the limitation of wherein the reference marker is a location marker 
indicating a measure location in the first audio recording as the technique of Audio play marker 
under time-line 84 (see Fig. 5). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of wherein the reference marker is a 
location marker indicating a measure location in the first audio recording into that of 
Baumgartner invention. By doing so, the system would be enhanced by providing more detail of 
timing information of audio information to an end user. 

As per claim 24, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of wherein the reference marker is a time 
marker indicating a time location in the video recording. 
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Boezeman discloses the limitation of wherein the reference marker is a time marker 
indicating a time location in the video recording as the technique of time-line marker 84 for 
reference mark of Video play (see Fig. 9). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman' s teaching of wherein the reference marker is a time 
marker indicating a time location in the video recording into that of Baumgartner invention. By 
doing so, the system would be enhanced by providing more detail of timing information of video 
information to an end user. 

As per claim 25, due to the similarity of this claim to the combination of claims 2 and 3, 
this claim is therefore rejected for the same reasons applied to claims 2-3. 

As per claim 23 , due to the similarity of this claim to the combination of claims 2 and 3, 
this claim is therefore rejected for the same reasons applied to claims 2-3. 

As per claim 26, Baumgartner discloses the invention substantially as claimed above. 
Baumgartner, however, does not disclose the limitation of wherein the tempo synchronizing is 
performed using the reference marker in the video recording and a position of the first audio 
recording to which a user drags the reference marker. 

Boezeman discloses the limitation of wherein the tempo synchronizing is performed 
using the reference marker in the video recording and a position of the first audio recording to 
which a user drags the reference marker as the technique of synchronizing Video Play and video 
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Play (see Fig. 8) and wherein the play tool 88 is dragged and dropped onto the visibility block 
105 as indicated by a play icon 142 and a play area 143. Since a piece of audio plays for a finite 
period of time, the audio player part 140 can be seen to have an approximate duration of about 
30 seconds (see col 7, lines 32-36 and see Fig. 6). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to include Boezeman's teaching of wherein the tempo synchronizing is 
performed using the reference marker in the video recording and a position of the first audio 
recording to which a user drags the reference marker into that of Baumgartner invention. By 
doing so, the system would be enhanced by providing drag and drop tool for synchronizing video 
and audio interface to an end use. 



disclosure. Applicant is required under 37 C.F.R. 1 . 1 1 1(c) to consider these references fully 
when responding to this action. The documents cited therein teach a method and a system for 
synchronizing audio information to video information in audio-video interface. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should bedirected to CUONG T THAI whose telephone number is (703) 308-7234. 
The examiner can normally be reached on 8:00 am - 4:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Cabeca, can be reached at (703) 308-3 116. 



Conclusion 



5. 



The prior art made of record and not relied upon is considered pertinent to applicant's 
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The fax numbers for the organization where this application or proceeding is assigned are 
as follows: 

(703) 746-723 8 (After Final Communication) 

(703) 872-9306 (Official Communication) 

(703) 746-7240 (For status inquiries, Draft Communication). 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-8000. 

CUONG T THAI 
Examiner 
Art Unit 2173 



November 17, 2003 




RAYMOND J. BAYERl 
PRIMARY EXAMINED 
ART UNIT 21 73 



